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Abstract 

We show that for a compact design space K (which may in gen- 
eral he K d C^) the sequence of probabihty measures jig that give 
the so-called D-optimal (or, equivalcntly, G-optimal) experimen- 
tal design for polynomial regression by multivariate polynomials 
of degree n, converges weak-* to the equilibrium measure jXK of 
Pluripotential Theory for K. 
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1 Introduction 

Optimal Experimental Design has a rich history within Statistics. The 
interested reader may consult the classical book of Karhn and Studden [KS] 
(especially Chapter X), the more recent monograph of Dette and Studden 
[DS], or even the Wikipedia article [W], and the references therein. As is 
well known (cf. [KS, Chap. X]), these optimal designs are equivalent to 
certain kinds of optimal points for polynomial interpolation. Specifically, 
D-optimal designs are equivalent to the so-called Fekete points of the set 
K. What may have received less attention in the Statistics literature is 
the fact that the asymptotics of such point systems (measures) is in one 
variable intimately connected to classical Complex Potential Theory and 
in several variables, as it turns out, to Complex Pluripotcntial Theory. 

In recent years much progress has been made in this latter field and, in 
particular, it allows the determination of the limit of the sequence of D- 
optimal measures as the degree of the polynomials on which regression 
takes place goes to infinity. The purpose of this note is to explain these 
developments and how they apply to Statistics. We begin with a review 
of the optimal designs that we wish to discuss. 

In practical applications the domains of interest are typically real cubes, 
balls, simplices or other nice geometric sets. But the theory is very general, 
and hence we take for our design space a compact X C C (later we will 
impose a mild regularity condition on K). We let Vs{K), denote the set 
of polynomials of degree s restricted to K and set n :— diin.{Vs{K)) . 

We may write any p e Vs{K) in the form 



k=l 

where Bs '■— {pi,P2, ■ ■ ■ ,Pn} is a basis for Vs{K). 

Suppose now that we observe the values of a particular p e Vs{K) at a set 
of m > n points X :— {xj : 1 < j < m} C K with some random errors, 
i.e., we observe 

yj=p{xj) + ej, l<j<m 

where we assume that the errors ej ~ N{0, a) are independent. In matrix 
form this becomes 



n 
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where y, ^, e e C and 



P\{X2) P2{X2) 



Pn{xi) 
Pn{x2) 



Pl{Xm) P2{Xm) ' ' " Pn{Xm) . 

is the associated Vandermonde matrix. 

Our assumption on the error vector e means that 

cov(e) = a^In e M"^". 

Now, the least squares estimate of 9 is 

9:^ {v:Vs)-X*y 

and we may compute the covariance matrix 

cov(^) = a^{V:V,)-\ 
Hence the confidence region of level t for 9 is the set 



{9 e C" : 



cov 



^ {9e C" : a-'^{9 - 9y{V;V,){9 - 9) < t}. 



The volume of such a set is proportional to 1 / ^y det{V*Vs) and hence 
maximizing the det(V/V<i) is equivalent to choosing the observation points 
Xi E K so as to have the most "concentrated" confidence region for the 
parameter to be estimated. 

Note however that the entries of — K*K are the discrete inner products of 

m 

the Pi with respect to the measure 

^ m 
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More specifically, 



where 



m 



Pi{z)pj(z)dii 



K 



(2) 



is the Moment, or Gram, matrix of the polynomials pi with respect to the 
measure /i. 

In general we may consider arbitrary probability measures on K, setting 
A4{K) :— {/I : // is a probability measure on K}. 

Definition 1.1 A probability measure (or design) n G Ai{K) is said to 
be a D-optimal measure of degree s if it has the property that 

det(M,(/x)) > det(M,(e)), G M{K). 

There is also a second statistical interpretation of D-optimal measures. If 
we set 

P2{z) 



P(^) 



Pniz) 



(3) 



then the least squares estimate of the observed polynomial is 

p\z)9. 

We may compute its variance to be 

var(p*(a:)^) = a'p*{z){V:Vs)-'p{z) 

= -aV(^)(M,(/.x))-^p(^) 
m 



(4) 



where /ix is again given by (1). 

In the Statistics literature (see e.g. [DS]) one usually denotes, for fj, e 
M{K), 

Gs{pi)^ms^p*{z){M,{ix))-'p{z). 
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Definition 1.2 A probability measure fj, G Ai{K) is said to be a G- 
optimal measure of degree n if it has the property that 



It follows from (4) that a G-optimal measure minimizes the maximum 
variance of the estimate of the observed polynomial. 

The remarkable Kiefer-Wolfowitz equivalence theorem states that these 
two notions of optimality are equivalent. 

Theorem 1.3 (Kiefer and Wolfowitz [KW]) A measure fi G Ai{K) with 
det{Ms{n)) ^ is G-optimal of degree s if and only if it is D-optimal of 
degree s. 

The G-optimality criterion has also an interpretation in terms of the poly- 
nomials orthogonal on K with respect to the measure fi. To see this, sup- 
pose that Ms{/d) is non-singular and note that then the matrix Ms{/d), 
being a Gram matrix, is positive definite. It's inverse is then also positive 
definite and hence has a Cholesky factorization {Ms{ijl))~^ — Ls{n)*Ls{ij) 
where Ls{ii) G C"^" is lower triangular. It follows that we may write 



Gs{^A < Gs{i), Ve G M{K). 



p*(^)(M,(/.))-ip(^) 



p*{z)Ls{nyLs{^J)v{z) 
{L,{^i)^{z)r{Ls{il)v{z)) 



n 



where 



q2 



pi 

P2 



q := 



Pn 



The polynomials qj are in fact orthonormal as 




Jk J Jk 
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= / {L,{^,)p{z)){L,{^,)piz)rd^^{z) 

JK 

= / Ls{^J)p{z)p{zyLs{^lyd^i{z) 

JK 

= L,{^)(^J^Piz)pizrdfiiz)^Lsif^r 

= {Ls{fi)Ms{fi)L,{fiyy 
= I. 

Indeed, since I/s(/i) is lower triangular, the Qj are the just the result of 
applying the Gram- Schmidt orthonormalization procedure to the pj. 

Now note that 

n 

is the diagonal of the reproducing kernel for Vs{K) (with respect to the 
measure fx) and is sometimes also called the (reciprocal of the) Christoffel 
function. It plays an important role in the theory of Orthogonal Polyno- 
mials. 

Hence 

var(p*(z)^) = ^a''K^{z) (6) 

and the experiment that minimizes the maximum variance of the estimate 
of the observed polynomial is exactly the one that minimizes the maximum 
of K^. 

For each s there is a D-optimal measure /Xg. We will show that these /x^ 
converge (in the weak-* sense) to what is called the equilibrium measure of 
Complex Pluripotential Theory for K. In order to make this more precise 
we will need first of all to introduce some of the basic notions of this theory. 
We refer the reader to the monograph [K] and also to Appendix B of [ST] 
for more details. 

Definition 1.4 A function u : ^ [— oo, cxo) is said to be plurisuhhar- 
monic (psh) if it is upper semi-continuous (use) and, when restricted to 
any complex line, is either subharmonic or identically — oo. 
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Definition 1.5 A set K G is said to be pluripolar if there exists a psh 
function u, not identically — oo, such that u{z) = — oo for all z G K. 

(Pluri)polar sets are in some sense the inconsequential sets of Potential 
Theory and are too "small" for there to be a reasonable theory. A proto- 
typical example of a psh function is u — log |/| where / is holomorphic on 
C^. In particular, for such au, u = —oo on the zero set of /, which is there- 
fore a pluripolar set. More generally, any complex analytic variety (other 
than all of C'') is pluripolar. We will henceforth make the assumption that 
the design space K is non-pluripolar. 

In Section 3 below we will state the convergence theorem. But first we 
will show that the notions of D-optimal and G-optimal can be generalized 
to the so-called weighted case. The introduction of such a weight is a 
crucial step in the proof of the main theorem. We note that these results 
have appeared elsewhere (see [BBLW]) but here we offer much simplified 
proofs, based on the integral formulas of Lemma 2.4, which are adapted 
from standard results used in Random Matrix Theory (see e.g. [D]). 

2 Weighted Optimal Designs 

Consider a design space K C C^, compact and non-pluripolar. 

Definition 2.1 A function w : K ^ M. is said to be an admissible weight 
function if 

(i) w > on K 

(a) w is upper semi- continuous 
(Hi) the set 

{zeK : w{z) > 0} 

is not pluripolar. 

For n a probability measure on K and admissible weight w we denote the 
associated weighted inner product of degree s by 

{f,9)^,v.:^ [ W)9{^Wi^)dli. (7) 
Jk 
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For a (fixed) basis Bg = {Pi,P2, ■ ■ ■ ,Pn} of Vs{K) we form the weighted 
Moment (Gram) matrix 

Mr = Mr{Bs) [(pi.Pi)^.A e C^"- (8) 
and the associated weighted Christoffel function 

n 

Kr{z) := \qAz)\v{z) = {p{z)nMr)-Mz) (9) 

where, as before, Qn = {qi, 52, ■ " ' > In} is an orthonormal basis for Vs{K) 
with respect to the inner-product (7). We note that as the Christoffel func- 
tion is (essentially) the diagonal of the reproducing kernel, it is independent 
of the particular orthonormal basis Qs- For its statistical significance see 
(6). 

Definition 2.2 Suppose thatw is an admissible weight on K. A probability 
measure (or design) /i e A4{K) is said to be a weighted D-optimal measure 
of degree s if it has the property that 

det(Mf "0 > det(M|''"), G M{K). 

Definition 2.3 Suppose thatw is an admissible weight on K. A probability 
measure ji E M. (K) is said to be a weighted G-optimal measure of degree 
s if it has the property that 

maxKriz) < max Kf'^iz), e MiK). 

By (the proof of) Lemma 2.1 of [KS], Chapter X], the set of matrices 

{Mr : A* is a probability measure on K} 

is compact (and convex). Hence D-optimal and G-optimal measures of 
degree s for K and w always exists. They will not in general be unique. 

We recall that for a basis Bg and a set of points Xs — {zi : 1 < i < n} C K 
the matrix 

Vsiz,, Z2,---, zn) = X,) = [p^izi)] e C"X" (10) 
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is called the Vandermonde matrix of the system. We will let 

VDM{zi,Z2,---,Zn)^VDMBSzi:---:Zn) := det(K(zi, • • • , (11) 
denote its determinant. 

We will make use of the following two formulas that express det(Mj^'"') 
and K^''^ in terms of these Vandermonde determinants. 

Lemma 2.4 Suppose that /i e /A{K) and that w is an admissible weight. 
Then (of. formula (3.3) of [BL]) 

detiM^'"") = (12) 

^ / \VDM{zi,---,Zn)\M^lf'---<Znf'M^l)---MZn). 

and 

Kriz) = (13) 

77/ / 

— / \VDM{Z, ^2, ■ ■ ■ , Zn)\M^yM^2f-' ■ ■ ■ w{Znf'dll{z2) ■ ■ ■ dll{Zn) 

where 

Z„ n!det(Mf'"') 

- / \VDM{zi, Zr,)\Mzif' ■ ■ ■ w{Znf'dfi,{z,) ■ ■ ■ dfisiZn)- 

Proof. As before, let Lg e ^nxn ^ lower triangular Choleski factor of 
{M^""")-^, i.e., such that 

(Mf ■'")-i = L^Ls. 
It follows then that the basis Qs ■= {qi, ?2, • " " > Qn} given by 



" Qi ' 




' Pi ' 


Q2 




P2 
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is orthonormal with respect to the inner product (7). 

It is elementary to verify the basis transition formula for Vandermonde 
matrices, 

V,{B,) = Vs{Qs)L:' 

and hence that 

|det(K(B,))p = |det(K(B,))|Met(L;i(L;^)*) 
= \det{Vs{Bs))\Met{MD. 

In other words, 

\VDM{z,,---,Zn)\' = \VDMB^iz,,---,Zn)\' 

= detiMr)\VDMQSz,,---,Zn)\'. (14) 

Now, by the Leibniz formula for determinants, 

n 

VDMqXzi, ■■■,Zn)^ ^sgn(a) (15) 

cr 1=1 

and by orthogonality, 

/ \VDMq^{zi, • • • , Zn)\Mzif' ■ ■ ■ w{Znf'dfl{z,) ■ ■ ■ dfl{Zn) 
= / VDMqXzx, • • • , ZnWDMqXzu Zn)w{Zif' ■ ■ ■ w{Znf'dlx{Zi) ■ ■ ■ dfl{Zn) 

— n\ 

as there are n\ permutations. The formula (12) now follows from this and 
(14). 

The proof of (13) is very similar. Using again the Leibniz formula (15), we 
easily see that 

/ \VDM{Z, Z2,---, Zn)\Mz?Mz2T' ' ' ' w{Zn)'' dfl{z2) ■ ■ ■ dfl{Zr,) 

n 

= j2cMji^)\'w{zr 

i=i 
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for some constants Cj. But by symmetry, all the Cj must be the same, i.e., 

/ \VDM{Z, Z2,---, Zn)\MzfMz2Y' ■ ■ ■ w{ZnTdn{z2) ■ ■ ■ dll{Zn) 

= CK^'^^iz) 

for some constant C. The value of the normalization constant C given by 
(13) follows by integrating both sides over K with respect to w{zY^diJi{z) 
and noting that 

I K^''"{z)w{zf'dfi{z)= I =n 
by the orthonormality of the Qj. ■ 

The Kiefer-Wolfowitz equivalence theorem also holds in the weighted case; 
a proof is given in Prop. 3.1 of [BBLW]. Here we offer a somewhat simpli- 
fied proof based on the integral formuals of Lemma 2.4. 

Proposition 2.5 (Weighted Kiefer-Wolfowitz [KW]) Let w he an admis- 
sible weight on K. A probability measure /i for which M^'"^ is non-singular 
is a weighted D-optimal measure of degree s if and only if it is a weighted 
G-optimal measure of degree s with the property that 

maxK^''"(z) ^n. 
zeK ^ ^ ' 

Proof. First note, as already observed by Kiefer and Wolfowitz, the func- 
tional 

// ^ log(det(Mi^'^)) 

is concave. Indeed this follows easily from the fact that, for //^ := tii\ -|- 
(1 -^))"o, 

Mf ''^ = tMf + (1 - t)M^°''"; 
see either [KW] or else [Bo] for the details. 
Hence, a probabilty measure /Iq is D-optimal iff h'{0) < for 

h{t) = hit- 110,11^) := log(det(Mf '-)) 
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and all fii G M{K). 

But, from the formula (12), h{t) is the logarithm of a polynomial of degree 
n in t and one may easily compute 

h'{0) = / K^^'^{z)diii{z) - n. (16) 
Jk 

Assume now that /y,o is D-optimal. For z & K take iJ>i — 5^, the measure 
supported at z. Then (16) becomes 

'"'(^) < n 

and since z E K was arbitrary, 



maxXf'"'<n. (17) 



Since 



/ Kf-wiz^d^is) = ! j^\q,{z)\M^rd^{^) = n 

JK JK ■ 1 



we must have max Kl''"{z) > n for all ^ e A1(X). In other words, by (17), 

zeK 

Ho is G-optimal (cf. Definition 2.3) and 



maxK^''''"(z) = n. 
zeK ^ ^ ' 



Conversely, suppose now that \iq G M.{K) is G-optimal with the property 
that 



z^K * 

Then, from (16) we have 

/i'(0) = / K^°''"{z)dni{z) - n< I ndni{z)-n^n-n^O, 

JK JK 

for all Hi e M.{K), and we see that hq is also then D-optimal. ■ 



From now on we will say that a measure is optimal if it is either D-optimal 
or, equivalently, G-optimal. 

The last statement of the preceeding proposition yields the following key 
property of optimal measures. 
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Lemma 2.6 Suppose that jj, is optimal for K and w. Then 



Kr{z)=n, a.e.ifj]. 



Proof. On the one hand 



max i^f ' 




while on the other hand, again by orthonormality of the Qj, 

JK JK 

and the result follows. ■ 

Of fundamental importance for us will be 

Definition 2.7 Suppose that K G is compact and that w is an admis- 
sible weight function on K. We set 



where rUg = dsn/{d + 1) is the sum of the degrees of the n monomials of 
degree at most s. Then 



is called the weighted transfinite diameter of K. We refer to Sf{K) as the 
weighted sth order diameter of K. 

A proof that this limit exists may be found in [BL] or [BBl]; it was first 
proved in the unweighted case {w = 1; i.e., 6^{K)) by Zaharjuta [Z]. 

Given the close connection between Vandermonde matrices and Gram ma- 
trices, it is perhaps not suprising that we have 




l/m, 



meo<i\VDM{zi, ■ ■ ■ , Zn)\w^ {zi)w^ {Z2) ■ --w^zn) 



5'"{K) = lim 5'^{K) 
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Proposition 2.8 Suppose that K is compact and that w is an admissible 
weight function. Suppose further that fis is an optimal measure of degree s 
for K and w. Take the basis Bs to be the standard basis of monomials for 
Vs. Then 

lim det(Mf = 
Proof. This is Proposition 4.3 of [BBLW]. ■ 



Of course, it then follows that 

lim log det(Mf '"') = log(r (i^)). (18) 
s->oo 2ms 

Now, suppose that u e C{K) and that w is an admissible weight function. 
Following the ideas in [Be, BBl, BB2, BN, BBN] we consider the weight 
Wt{z) :— w{z)ex^{—tu{z)), i e R, and let ^s be an optimal measure of 
degree s for K and w. We set 

fsit) -.^-^ log det(Mf (19) 

For t = 0, Wo = w and (18) says 

lim/,(0) = -log(5-(X)). 

s— >-oo 

We have the following formula for the derivative of fg. 



Lemma 2.9 We have 

= - 

dn 



K 



In particular, 



d + 1 



I u{z)djj,s (by Lemma 2.6). (20) 
Jk 
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Proof. This was proved by different means in [Be, Lemma 6.4] and 
[BBLW, Lemma 3.5]. The proof we offer here is based on the integral 
formulas of Lemma 2.4. 

By (12) we may write 
where 

F,{t) := / Vexp{-tU)dn 



and 



V := V{z,,Z2,---,Zn) = \VDM{z,,---,Zn)\Mzi)''---w{znf% 
U 



U{zi,Z2, - ■ ■ ,Zn) = 2s{u{zi) H hu{Zn)), 

djjis{zi)diJis{z2) ■ ■ ■ dns{zn). 



Further, by (13) for w = Wt and = /ig, we have 

Tl f 

= ^ / y{z, Z2, Z3,---, Zn) exp(-iC/)d//,(z2) • • • dfis{Zn) 

where 

Z„ = Z^{t) := n\ det(M,'^""'*) ^ [ V exp(-i[/)d/i. 



Note that Zn{t) = F,(i). Now 

■'^^^ 2msFs{t) 

and we may compute 

Kit) = / V{-U)eM--tU)diXs{z^)---diXs{zn) 

= -2s / {u{zi)^ ^u{zn))Ve-K^{-tU)diJis{zi)---diJis{zn). 

Notice that the integrand is symmetric in the variables and hence we may 
"de-symmetrize" to obtain 

F'^(t) = -2sn / u{zi)V(zi, ■■■,Zn) ex.p{-tU)di^s(zi) ■ ■ ■ djigizn) 

15 
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so that, integrating in all but the Zi variable, we obtain 

F'^{t)^-2sn [ u{z)K^"'"'{z)—dfXs{z). 
Thus, using the fact that Zn{t) — Fs{t), we obtain 

1 m 



fs{t) 



2msF,{t) 

^ {2s) [ u{z)K^-^^{z)dfis{z) 



2m„ 

s 



K 



dsn/ (d + 1 
d+1 



u{z)K':^^^\z)diis{z) 



K 



dn 

as claimed. In particular. 



K 



m = ^ l^u{z)K^--{z)dt,,{z) 
/ u{z)diJis{z) 

JK 



d+1 



d 

by Lemma 2.6. ■ 

The next result was proved in a different way in [BBN, Lemma 2.2] and 
also in [BBLW, Lemma 3.6]. 

Lemma 2.10 The functions fs{t) are concave. 

Proof. Since fs{t) is twice differentiable we need only to show that fJit) < 
0. Now, with the notation used in the proof of Lemma 2.9, 

..... ^ 1 jFm'-K'jt) 

2m, F^{t) 

and 

F^{t) = -— I UV exp{-tU)dfi, 
F'Jit) ^ -J U'V eM-tU)di,. 
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We must show that (F^'(t))^ — F^'{t) > 0. Now, for a fixed t, we may 
muhtply by a constant so that 

/ V ex.-p{-tU)dn ^ 1. 

Let d'y := V exp{—tU)dii. Then by the above formulas for and F", we 
must show that 

/ U^d-f > [ [ Ud-f 
but this is a simple consequence of the Cauchy-Schwartz inequality. ■ 




3 The Limit of Optimal Measures (Designs) 

In this section we state the main theorem. Let K C he compact with 
admissible weight function w :— e~'^. 

The class of psh functions of at most logarithmic growth at infinity is 
denoted by 

C:— {u : u is psh and u{z) < log^ \z\ + C}. 

Of special importance is the weighted pluricomplex Green's function (also 
known as the weighted extremal function), 

Vk,4>{z) ■— sup {u{z) : u e C, u < cf) on K}. (21) 

The function V^^^{z) denotes the use regularization of VK,ct>- 

Associated to the extremal function is the so-called weighted equilibrium 
measure, 

m,:=j^,{dd^Vl,r. (22) 

Here {dd'^vY refers to the non-linear complex Monge- Ampere operator (ap- 
plied to v)] it reduces to (a multiple of) the Laplacian in the dimension 
d=\ case. 

That iiK,4> exists and is a probability measure is one of the main results 
of Pluripotential Theory; we again refer the reader to [K] or [ST] for the 
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details. We remark, that in one variable, for K — [—1, 1] C C, and the 
unweighted case, i.e., w = 1 and = 0, then 

1 1 , 



If /i, /2, • ■ ■ ) /n £ K are weighted Fekete points of degree s for K, i.e., 
points in K for which 

\VDM{zi, • • • , z^)\w'{z,)w'{z2) ■ ■ ■ w'iz,,) 

is maximal, then we may define a discrete probability measure 



-'-i:^f^- (23) 



n 

k=l 



Berman and Boucksom [BB2] have recently shown that these discrete prob- 
ability measures (23) tend weak—* to fiK,cf>- This is based on a remarkable 
sequence of papers (see [Be], [BBl], [BB2], [BN]). Indeed, the argument 
in [BB2] shows that if for each s, we take points z[^\ Z2 \ • • • , Zn^ e K for 
which 

lim [\VDM{z[''\ ■ ■ ■,z^j:^^)\w{z['^yw{zi'^y ■ ■■ w{z^j^^ = ^(X) 

n— >oo 

(24) 

{asymptotically weighted Fekete points), then the discrete measures 

N 



n ^ — ' ^fc 

fe=l 

converge weak—* to Hk,ci>- The main point of [BBLW] was to remark that 
their proof may be extended to also give the limit of optimal measures 
(designs). 

Main Theorem. Suppose that K G is compact and that w is an 
admissible weight function. We set := — log('u;). Suppose further that jig 
is an optimal measure of degree s for K and w. Then 

hm Us = fJ'K,,!' 

s->oo 
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where the limit is in the weak—* sense. 

Proof. This is the main result of [BBLW]; its proof is given there. ■ 

4 Examples of Equilibrium Measures 

It turns out (sec [BT]) that for several important special design spaces K, 
the unweighted {w = 1) equilibrium measure can be calculated: 

• For K — [—a, C M.^, a cube, the equilibrium measure is 



fJ'K 



— xt 



where dx is Lebesgue measure on M'^ and is the constant, that 
depends only on the dimension d, that makes this a probability mea- 
sure. 

• For K = {x & M!^ : \x\ < a}, the ball of radius a, the equilibrium 
measure is ^ 

UK = CrfO"^'^-^^^ dx 

■y'a^ — \Xf 

where dx is Lebesgue measure on R*^ and Cd is the constant, that 
depends only on the dimension d, that makes this a probability mea- 
sure. 

• For K = {x eR''' : Xi>0, Yli=i ^ simplex of "radius" a, 
the equilibrium measure is 

fiK = Cga-^'^-^^/''— ^ dx 

V (« - Etl ^i) ntl 

where dx is Lebesgue measure on M"' and Cd is the constant, that 
depends only on the dimension d, that makes this a probability mea- 
sure. 

We also offer a weighted example. Take 

K^izeC^ : \z\< 1} 
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with (f){z) — 1 2; p. Then it can be verified that the extremal function is 



From this one may readily compute /x^^^ is Lebesgue measure supported on 
the ball {z E : \z\ < l/-\/2}, normalized to be a probability measure. 
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